United States Patent m 

Luxenberg et al. 


[ii] Patent Number: 5,013,038 
[45] Date of Patent: May 7, 1991 


[54] METHOD OF EVALUATING DATA 
RELATING TO A COMMON SUBJECT 


[75] 

Inventors: 

Robert A. Luxenberg, Sunnyvale; 



Robert J: Brown, Los Altos Hills, 



both of Calif. 

[73] 

Assignee: 

Interactive Network, Inc., Mountain 



View, Calif. 

[21] 

Appl. No.: 

448,001 

[22] 

Filed: 

Dec. 8, 1989 

[51] 

Int. CM . .. 

A63F 9/22; H04H 9/00 

[52] 

U.S. CI 

273/439; 379/92; 


358/84; 455/2 

[58] 

Field of Search 273/1 E, DIG. 28, 138 A; 


358/84, 85; 455/2; 379/92 


[56] References Cited 

U.S. PATENT DOCUMENTS 


3,947,624 3/1976 Miyake 358/84 

4,107,735 8/1978 Frohbach 358/84 

4.151,370 4/1979 Root 455/2 

4.592.546 6/1986 Frascenda et al. 273/1 E 

4.630,108 12/1986 Gomersall 358/84 

4.722.526 2/1988 Tovar et al 273/1 E 

4,876,592 10/1989 Von Kohorn 455/2 


OTHER PUBLICATIONS 

Fenton, Brian C, "Interactive TV", Radio Electronics, 
. Dec. 1988, pp. 45-47, 106. 

Primary Examiner — Edward M. Coven 
Assistant Examiner— Jessica J. Harrison 
Attorney, Agent, or Firm — Flehr, Hohbach, Test, 
Albritton & Herbert 

[57] ABSTRACT 

A method of determining the winners of, for example, a 
game of skill in conjunction with a football or baseball 
game without the input of all the scores is provided. By 
the use of statistical sampling a small fraction of the 
remote players upload their scores to a central station 
via a telephone line, for example. Then, when the tenta- 
tive winners are determined from this small statistical 
sample, the mass communications link of the system 
downloads the statistical curve to all of the players and 
only those players who are equal or better than the 
winning score telephone. Thus, time and money are 
saved for the telphone up-link. Furthermore, over- 
crowding of the telephone system is avoided by a 
proper delay given the individual remote sources. 

3 Claims, 5 Drawing Sheets 
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METHOD OF EVALUATING DATA RELATING TO 
A COMMON SUBJECT 

The present invention is directed to a method of 5 
evaluating data relating to a common subject from a 
plurality of remote data sources and more particularly 
to sampling the remote data sources to avoid the input 
of all data. 

BACKGROUND OF THE INVENTION 10 

As described in the Lockton, et al., U.S. Pat. No. 
4,592,546, home television viewers of a football game 
may attempt to predict, for example, the play to be 
called by the quarterback and then be scored on their 15 
success. As suggested by the patent, the overall control 
of this scoring is done by a one-way mass communica- 
tions link from a central station; for example, it may be 
the SCA channel of an FM radio station or a vertical 
blanking interval (VBI-Teletext) of a television pro- 20 
gram itself. Then the score is stored at the home view- 
er's location, which can be characterized a remote data 
source, and is uploaded to a central station by. for exam- 
ple, a telephone call. 

One difficulty with the foregoing is that the upload- 25 
ing of all information to a central computer via the 
telephone system may overload the telephone ex- 
changes, especially in large cities. Of course, the same is 
true if a packet type system is used to collect data for 
final communication with a central telephone office. 30 
This might especially be of a Superbowl football game 
or a World Series baseball game. Of course, one of the 
incentives to playing the game— even if the player may 
have a relatively low score— is to determine his rank or 
percentile standing with regard to the remainder of the 35 
participants. 

Another technique of evaluating responses to a 
broadcast television program is shown in the Von Ko- 
horn U.S. Pat. No. 4,745,468 which discloses the tech- 
nique of competing, for example, in a television game 40 
show. It is also stated to be applicable to a football 
game. Here the viewers' scores and/or responses are 
recorded on a magnetic card. Then the card may be 
physically taken to some central location to receive a 
prize. Here again, the ranking or percentile standing of 45 
a particular player is not immediately known. 

OBJECT AND SUMMARY OF INVENTION 

It is therefore a general object of the present inven- 
tion to provide an improved method of evaluating data 50 
relating to a common subject from a plurality of remote 
data sources. 

In accordance with the above object there is pro- 
vided a method of evaluating data relating to a common', 
subject from a plurality of remote data sources where 55 
each source may be down-loaded information on a one- 
way mass communications link from a central station 
but must up-load from each of the remote sources to a 
central station by a dedicated and exclusive communi- 
cations up-Knk. The method comprises the steps of 60 
statistically sampling a plurality of the remote data 
sources, such plurality being a small fraction of the total 
number of the data sources. Such sampling is accom- 
plished by signaling the mass communications link. 
Each of the data sources is responsive to the signaling to 65 
up-load data via the dedicated and exclusive respective 
up-links to the central station. At the central station a 
statistical curve is determined related to this statistically 


2 

sampled data and information as to such curve is down- 
loaded via the mass communications link to the remote 
sources. This is for use in comparing the data of each 
remote source to the statistical curve to determine an 
accurate percentile standing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an overall block diagram of a system incor- 
porating the present invention. 

FIG. 2 is a more detailed block diagram of a portion 
of FIG. 1. 

FIG. 3 is a flow chart showing one embodiment of 
the operation of FIGS. 1 and 2. 
FIG. 4 is a flow chart showing another embodiment. 
FIG. 5 is a flow chart showing another embodiment. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

FIG. I shows a communications network with a cen- 
tral station 10 and one of many remote terminals or data 
sources 11. Associated with the remote terminal 11 
would normally be a television receiver 12 to receive, 
for example, the football or baseball game on which the 
game might be based. Although in a description of prior 
art, such as in the above Lockton, et al., patent, football 
has been emphasized, other games could be video com- 
puter games and/or a quiz show; furthermore, a special- 
ized television show for purely commercial purposes,, 
for example, to. evaluate a proposed new product of a 
manufacturer. Here the television viewer would be 
asked to respond to the new product as certain features 
are mentioned or introduced. 

In any case, in one embodiment the television re- 
ceiver 12 would receive the football game from a TV 
network illustrated at 13, which signal is also received 
by game central 10 for purposes of timing, as described 
in the Lockton, et al., patent. For example, a lockout 
signal would normally be transmitted to the remote 
terminal 11 after the snap of the ball in the football game 
to prevent late guesses as to the type of play that was 
called. 

Associated with the game central 10 which would 
normally be a computerized office is a main data com- 
puter 14 for receiving the game scores from several 
centra] telephone offices 16. In conjunction with the 
central offices 16, the authorization computer 17 would 
determine whether to accept the information in accor- 
dance with an authorization code which might be the 
remote terminals identification number and other secu- 
rity checks. 

Control information as to the game itself (such as the 
lockout signal) might be handled in the same manner as 
in the Lockton, et al., patent where a transmitter 18 
provides data on a subcarrier (SCA) channel of an FM 
radio station or the vertical blanking interval television 
station via satellite 19. This information might be re- 
ceived by satellite receiver 21 and retransmitted via RF 
transmitter 22 to the remote terminals 11. After the 
playing of the game or the. time which has been desig- 
nated for returning responses to the central station 10, 
remote terminal 11 utilizes its telephone 23 to communi- 
cate, if necessary, its data to game central 10. This tele- 
phone link might broadly be characterized as an up-link 
which is a dedicated and exclusive communications 
channel. Naturally, it has capacity limitations and is 
much more expensive than the down-link, which is the 
mass communications channel from the transmitter 18 
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via the satellite 19 or just normal television broadcasting 
antenna or FM radio antenna. 

Game central 10 has its overall control determined by 
a programming source 24. As will be described in detail 
below for statistically sampling the various remote ter- 5 
minals 11 (which might total millions), a random identi- 
fication number generator 26 is provided. Very briefly, 
statistical sampling is provided by generating a group of 
numbers relating to the possible identification numbers 
of all of the remo.te terminals and selecting a relatively 10 
small fraction of the total number of remote terminals 
11 or data sources which represent a random sample or 
cross section. This is all in accordance with statistical 
sampling theory in order to produce a valid sample of 
this allowable error. 15 

A single remote terminal 11 is shown in detail in FIG. 
2 and typically includes a microcomputer 31 (e.g., a 
persona! computer) which is coupled to the transmitted 
information via a network receiver 32 and an antenna 
33. As discussed above, this antenna may receive cither 20 
the subcarrier of an FM radio station or the vertical 
blanking interval of a television station or any other 
mass communications technique. Programmed into the 
network terminal unique to each remote station is the 
identification (ID) number 34 which serves to authenti- 25 
cate each remote terminal and in addition allows it to be 
selected for the statistical sampling as will be discussed 
below. However, for this purpose other information can 
be used such as the user's address, phone number, elc. 

Also associated with microcomputer 31 are the nor- 30 
mal accessories such as a display unit 36, a keyboard 
input 37, which may be utilized for game playing or 
control purposes and in general, for the input of any 
other type of survey data. A memory unit 38 is used for 
general microcomputer purposes and also as indicated 35 
for storing a delay time which will be used to respond 
via telephone or the dedicated and exclusive communi- 
cations up-link to the central station 10. This will be 
described in greater detail in conjunction with the flow 
chart of FIGS. 4 and 5. With regard to this delay, a 40 
delay generator 39 is connected both to memory 38 and 
microcomputer 31 to be activated by the proper signal 
from the mass communications channel which is con- 
nected to the network receiver 32. Network receiver 32 
also controls the access to the telephone line indicated 45 
as 41. 

The flow chart of FIG. 3 applies both to the opera- 
tion of the remote terminal 11 shown in FIG. 2 and also 
interfaces with the operation of game central 10. Refer- 
ring to the top of the flow chart, game central 10 gives 50 
a 'start game' signal. As shown by block 42, the game is 
played using the data from the central station or net- 
work. Such data in a simple situation might include 
merely lock-out information and scoring information as . 
described in the above Lockton, et al., patent. In a more 55 
complex situation a computer game might be played as 
described in a co-pending application, Ser. No. 365,050 
filed June 9, 1989, and assigned to the present assignee. 

To continue with the flow chart in the block 43 the 
game or statistical survey ends, whichever is the case, 60 
and a score or answer results. Next, in block 44 data is 
received from the central network or game central 10 as 
to whether the particular remote data source 11 is in this 
statistical sample. This is executed by the block 46 
which asks is this unit or remote data source in the 65 
statistical sample? This may be determined, referring to 
FIG. 1, by a comparison of the identification number of 
the remote source with the random identification num- 
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ber generator generated by unit 26 at the central station. 
Other techniques, as outlined above, are obviously suit- 
able. 

If the remote data source or unit is in the statistical 
sample, then an instruction is given at this time to send 
the data to the central computer via the telephone up- 
link, for example. This is determined by the block 49. 

Alternatively, if the unit is not in a statistical sample, 
step 50 is gone to where the unit waits for receipt of a 
statistical ranking. This is done as soon as the centra! 
station receives the full statistical sample sent to it in / 
step 49. At that time a statistical curve or similar type of 
data is sent to each remote user and a display ranking 
occurs on the remote terminal's display unit 36 (see 
FIG. 2) as indicated by step 61. Then the game or the 
survey (whatever is the case) is ended in step 62. 

Thus, in summary, either game scores on he results of 
a survey are gained from a large number of remote data 
sources where only a small fraction of such data sources 
is required to telephone or up-load their data. At the 
same time, the user at the remote source— if a game 
player — still receives his win, loss or relative ranking. 
On the other hand, if the context of the game is more 
market research oriented, the fact that the statistical 
ranking or results of the research will be down-loaded 
to the consumer serves as an incentive to respond to the 
initial questions. 

In the case where there is a "pure" game situation 
where only winning scores are relevant and overall 
statistical results are not needed, FIG. 4 illustrates a 
variation of the method of the present invention. Here, 
after the game is played as indicated in step 42 and it 
ends as in step 43, each remote data source or unit is sent 
(as indicated in step 63) from the central station or net- 
work an individual delay time or a method of generat- 
ing a time delay. Such delay time may be precalculated 
or random. As illustrated in FIG. 2, it may be based on 
the serial number or identification number of that par- 
ticular source. In any case, all that is important is that 
the delay for each of the remote data sources be rela- 
tively unique so that the telephone lines to a central 
office (or packet unit) are not overloaded. After the 
downloading from the centra] station of the individual 
delays in step 52, data from the central network as to 
tentative winners is transmitted to the remote units or 
data sources. 

These winners may be thought of as tentative winners 
since initially when very few responses have been re- 
ceived, the leading winners will change frequently. 

Thus, perhaps initially estimated winning scores 
would be input from the central network but thereafter 
such tentative winners are based on previous responses 
from other data sources after their time delay has ex- 
pired. 

Next, in step 53, each data source compares its score 
with the leading winner. If less, then the W decision 
route goes to step 65 which is a *wait for the winners to 
be announced 1 and thereafter the end game block 66. If 
there is a 'yes' decision, meaning that data source has a 
score greater than or equal to the leading winner, then 
in step 47 the question is asked "is the time delay com- 
pleted?" If 'no/ the loop is gone through again. If 'yes,' 
then this data is sent via step 49 to the central computer. 
The winners announcement in step 65 would include 
the final list of winners. 

The foregoing system, as illustrated in FIG. 4, by 
eliminating the statistical survey, is believed to require 
even fewer telephone connections. This can be illus- 
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traled by the following mathematical treatment which FIG. 4), saves significant time and overloading of, for 

assumes that each unit will telephone the central station example, a telephone exchange, 

sequentially. And the same technique may be used in a marketing 

Assume there are N devices which need to be tested survey as briefly discussed above. For example, in con- 

for winner status, and assume that there are W winners 5 nection with a network news telecast, the large viewing 

to be determined. Assume also that the units are se- audience for this type of programming might generate 

lected one at a time completely random of their score, hundreds of thousands of responses. Only 2,000 are 

and that there is a single monotonically increasing rank- actually required to provide results with the required 

ing for every unit. The first W units to be tested will all degree of accuracy. 

require connection to the network since there will not j 0 From a more specific game standpoint, scoring of a 

be a list of W current leading winners until they send baseba)] for exampIe WO uld generally have sev- 

their scores to the central computer. The probability m} categorie5 0 f winners up to some fixed maximum, 

that the W+ 1 unit will need to be connected to the Cat ories might ^ established for strikeouts, home 

network is then W/w+ 1. The expected value of the an<j stQlen ^ Jhc j whh the x 

number of units needing to be connected is then: , 5 ^ ^ ^ ^ categorics wil , ^ ^ nnm 

The available categories for each case will be kept in 
7= m T 1 w/i an evcnt type file. If scoring is available for an event 

'**»'-<- 1 type, the first winner category will always be "overall 

winner" (the player with the highest score). After this 
As an example, suppose 100 winners are to be deter- 20 game spec jfi c categories may be specified — 

mined out of a group of 100,000 players. The average strikeouts, etc., as discussed above, 
number of connections required will then be: In summary, the primary feature of the present inven- 

tion is to reduce the number of telephone calls after a 

7= 10U * UX I KW - 100/r - 790 25 game 0r eVent i& 0Ver * 

" ^ i - 101 ' = The second feature is the ability to rank all of the 

players by using a relatively small number of samples of 
This is significantly less than the 100,000 connections the game scores. This is done by statistically selecting a 
which otherwise would have been required. small number of players to have their scores sent to the 

Thus, the foregoing mathematical treatment shows central computer. From these scores a statistical curve 
the significantly fewer telephone connections which are i s established. This percentile ranking profile is then 
required. The same result is similarly achieved with the scnt t0 all tne game units and each remote source will 
use of random or precalculated individual time delays. display the percentile ranking of all the players. 

FIG. 5 illustrates a method which combines the statis- Alternatively, the same object is achieved without 
tical survey technique of FIG. 3 with the winner com- statistical sampling by continuously* updating the tenta- 
parison technique of FIG. 4. Thus, steps 42 and 43 as to tive ^ne^ th us avoiding telephone calls from game 
the game being played and a score resulting are the p i aycrs w j tn lower scores. 

same. In step 44' data from the central network is re- Finally, a third feature of the invention is the ability 
ceived both as to whether or not the particular unit is in tQ detennine accurate and projectable market informa- 
the statistical sample and a random delay is also given tSon ffom ft u number of remote SOWXXSt Th i s i s 
each unit. If the unit is in the statistical sample, as shown w . done . ^ g statistical ^ using those 

in step 46 then this data is sent to the central computer . tQ Ject ^ response s of the larger population 
via step 49 over the 'yes' logic output line AS. At the Q * ?l m *m$ market information could be in the form 
same time this informal on the yes decision route 48 ^ tQ . fic tions . 
is anded with block 47 as to whether the random de ay improved method of evaluating data relating 

c^Val C c°o^ P uter mformatlon thcn 15 scnt to thc 45 to a common subject from a plurality of remote data 

^erX^Twcal sample is gained, then the data ^wrt^lSed' 0 ^' 56 ' 1, 

from the ^^^^^^ 1. Amethod of evaluating data relating to a common 

ner s curve, as shown in step 52 and 53. As discussed , . . , . j ♦ ° 

above, the s^ore of the remote data source is compared » subject to a plurality of remote data sources where each 
to the tentative winners' score. If it is less, then step 54 *° urce be down-loaded mformation on a one-way 
is gone to for waiting for winners to be announced and ™ss commumcations link from ^a central station but 
to receive the statistical curve information. must u P- lo * d dato from each of the remote sources to a 

If the score is greater than or equal to the leading , central station by a dedicated and exclusive communi- 
winner, then the 'yes* route of decision block 53 is taken 55 cations up-lmk, said method comprising the following 
and after the random delay is up, that data is sent to the steps: ....... 

central computer. And thereafter the game is ended in statistically sampling a plurality of said remote data 
st 55 sources, said plurality being a small fraction of the 

In summary, the foregoing method of FIG. 5 pro- total number of said data sources by signaling said 

videiboth a statistical curve and also limits the upload- 60 data sources via said mass communications link, 
ing of information via, for example, the telephone line. said data sources being responsive to said signaling 

And from a statistical point of view, according to mar- to up-load data via said dedicated and exclusive 

ket research statistics, no matter how large the universe respective up-links to said central station; 

of participants, a truly random sample of, for example, disabling said remote data sources not part of said 
2,000 users can place an individual's score with 95% 65 statistical sample from up-loading via said up-link; 
accuracy ±2%. Thus, by the foregoing techniques determining at said central location a statistical curve 
using statistical sampling or in addition, of providing related to said statistically sampled data and down- 

immediate feedback as to tentative winners (as shown in loading information of said curve via said mass 
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communications link to said remote sources indud- for each data source , comparing the score of said 

ing said disabled sources for use in comparing the tentative winner with the score of said particular 

data of said remote source to said statistical curve. data source; 

2. A method as in claim 1 where said common subject and if compared score of said particular data 

is a specific game of skill or change and where each of 5 so . urce , ,s ^ eater * a " or e ^ a l l f ° f Sa,d .f 11 ™^ 

..j i rv winner s score, up-loading said data to said central 

said data sources includes at least one player of such st£Uion and re uti said tentative winners . 

game who receives one or more scores, said step of 3 A melho(j as in claim l Qr % where dala M t0 a 

statistically sampling being utilized to determine tenta- random or p reca ] cu i ate d substantially unique delay is 

tive winners of said game who have the maximum score 10 down-loaded from said central station to each of said 

and including the additional steps of: remote sources, each remote source responding to said 

transmitting via said mass communications link to all signaling to up-load data via said dedicated and exclu- 

of said data sources, data as to the tentative win- sive link, if necessary, only after said respective delay. 

ners; * * * * * 
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